Andreas-Schniertshauer [Mon, 30 Mar 2020 11:51:44 +0000 (13:51 +0200)]
Fix memory leaks in tests case.c and misc.c (#189)
* Add: tests to CMakeLists.txt
* Disable compilation of charwidth, graphemetest and normtest because of missing getline
* Refactoring: UTF8PROC_ENABLE_TESTING default Off, move tests that don't compile on windows to NOT MSVC section, add testing to appveyor.yml
* Add: testing to travis
* Changed: flag to WIN32 because MinGW has the same problem as MSVC
* Commented out graphemetest and normtest because they fail.
* Re-added: graphemetest and normtest added missing data to the path of the text files.
* Fix: last commit was party wrong normtest failed.
* * Commented out graphemetest and normtest because they fail, because in CMakeLists is missing building of data.
* Add: mingw_static, mingw_shared, msvc_shared, msvc_static to ignore list
* Add: prefix utf8proc. to tests
* Fix: memory leaks in tests case.c and misc.c forgot to call free after calling utf8proc_NFKC_Casefold
Co-authored-by: Andreas-Schniertshauer <Andreas-Schniertshauer@users.noreply.github.com>
Steven G. Johnson [Sun, 29 Mar 2020 14:48:42 +0000 (10:48 -0400)]
Revert "disable tests under mingw" (#187)
This reverts commit
7e834d77024d770875559d853b09b8bb7f9321a1.
Steven G. Johnson [Sun, 29 Mar 2020 14:44:42 +0000 (10:44 -0400)]
use unsigned char more consistently, silence -Wextra compiler warnings (#188)
Steven G. Johnson [Sun, 29 Mar 2020 13:35:32 +0000 (09:35 -0400)]
fixes
Steven G. Johnson [Sun, 29 Mar 2020 13:01:04 +0000 (09:01 -0400)]
add build to gitignore, make paths absolute (closes #185)
Steven G. Johnson [Sun, 29 Mar 2020 12:53:11 +0000 (08:53 -0400)]
fix grapheme test to work on unmodified data file
Steven G. Johnson [Sun, 29 Mar 2020 01:25:42 +0000 (21:25 -0400)]
disable tests under mingw
Andreas-Schniertshauer [Sat, 28 Mar 2020 21:16:35 +0000 (22:16 +0100)]
Download data and execute commented out tests (#178)
* Add: tests to CMakeLists.txt
* Disable compilation of charwidth, graphemetest and normtest because of missing getline
* Refactoring: UTF8PROC_ENABLE_TESTING default Off, move tests that don't compile on windows to NOT MSVC section, add testing to appveyor.yml
* Add: testing to travis
* Changed: flag to WIN32 because MinGW has the same problem as MSVC
* Commented out graphemetest and normtest because they fail.
* Re-added: graphemetest and normtest added missing data to the path of the text files.
* Fix: last commit was party wrong normtest failed.
* * Commented out graphemetest and normtest because they fail, because in CMakeLists is missing building of data.
* Add: mingw_static, mingw_shared, msvc_shared, msvc_static to ignore list
* Add: downloading data and executing enabled tests that depend on the downloaded data.
* Fix: windows line endings CRLF replaced with linux LF
* Refactoring: (major) set UNICODE_VERSION to 13.0.0, replace curl with file DOWNLOAD, removed downloading unnecessary files, enabled normtest.
* Fix: woodhead error in revision
adeac82ec9941667e3c3ad7f50769793547218c3 readded calling execute_process to strip GraphemeBreakTest.txt file
* Add: removing no more used file data/GraphemeBreakTestOrg.txt after stripping.
* Add: testing folder to ignore list
* Add: enabled graphemetest
* Update .gitignore
Co-authored-by: Andreas-Schniertshauer <Andreas-Schniertshauer@users.noreply.github.com>
Co-authored-by: Steven G. Johnson <stevenj@mit.edu>
Steven G. Johnson [Sat, 28 Mar 2020 18:00:43 +0000 (14:00 -0400)]
Merge branch 'master' of https://github.com/JuliaLang/utf8proc
Steven G. Johnson [Sat, 28 Mar 2020 18:00:30 +0000 (14:00 -0400)]
silence warning (closes #184)
Andreas-Schniertshauer [Sat, 28 Mar 2020 14:31:27 +0000 (15:31 +0100)]
Tests with prefix utf8proc. (#177)
* Add: tests to CMakeLists.txt
* Disable compilation of charwidth, graphemetest and normtest because of missing getline
* Refactoring: UTF8PROC_ENABLE_TESTING default Off, move tests that don't compile on windows to NOT MSVC section, add testing to appveyor.yml
* Add: testing to travis
* Changed: flag to WIN32 because MinGW has the same problem as MSVC
* Commented out graphemetest and normtest because they fail.
* Re-added: graphemetest and normtest added missing data to the path of the text files.
* Fix: last commit was party wrong normtest failed.
* * Commented out graphemetest and normtest because they fail, because in CMakeLists is missing building of data.
* Add: mingw_static, mingw_shared, msvc_shared, msvc_static to ignore list
* Add: prefix utf8proc. to tests
* Add: prefix utf8proc. to tests
Co-authored-by: Andreas-Schniertshauer <Andreas-Schniertshauer@users.noreply.github.com>
Co-authored-by: Steven G. Johnson <stevenj@mit.edu>
Steven G. Johnson [Sat, 28 Mar 2020 14:00:18 +0000 (10:00 -0400)]
compile more tests on Windows (#183)
* compile more tests on Windows
* still disable charwidth tests
* silence warnings on MSVC about sscanf
* whoops
* silence warning
Steven G. Johnson [Sat, 28 Mar 2020 13:42:29 +0000 (09:42 -0400)]
simplifications
Steven G. Johnson [Sat, 28 Mar 2020 13:36:58 +0000 (09:36 -0400)]
portable getline replacement (closes #182)
Steven G. Johnson [Sat, 28 Mar 2020 00:36:18 +0000 (20:36 -0400)]
new emoji-data.txt location (fixes #181)
Steven G. Johnson [Fri, 27 Mar 2020 22:38:44 +0000 (18:38 -0400)]
update
Steven G. Johnson [Fri, 27 Mar 2020 22:35:20 +0000 (18:35 -0400)]
whoops, generated from old tables
Steven G. Johnson [Fri, 27 Mar 2020 21:32:42 +0000 (17:32 -0400)]
link fixes
Steven G. Johnson [Fri, 27 Mar 2020 21:22:21 +0000 (17:22 -0400)]
version bump to 2.5
Steven G. Johnson [Fri, 27 Mar 2020 21:06:06 +0000 (17:06 -0400)]
Unicode 13 support (#179)
* exclude Sk from zero-width chars (closes #167)
* update for Unicode 13
Andreas-Schniertshauer [Wed, 19 Feb 2020 19:25:19 +0000 (20:25 +0100)]
Add: tests to CMakeLists.txt (#173)
* Add: tests to CMakeLists.txt
* Disable compilation of charwidth, graphemetest and normtest because of missing getline
* Refactoring: UTF8PROC_ENABLE_TESTING default Off, move tests that don't compile on windows to NOT MSVC section, add testing to appveyor.yml
* Add: testing to travis
* Changed: flag to WIN32 because MinGW has the same problem as MSVC
* Commented out graphemetest and normtest because they fail.
* Re-added: graphemetest and normtest added missing data to the path of the text files.
* Fix: last commit was party wrong normtest failed.
* * Commented out graphemetest and normtest because they fail, because in CMakeLists is missing building of data.
Stefan Weil [Thu, 11 Jul 2019 18:04:34 +0000 (20:04 +0200)]
Fix some typos (found by codespell) (#160)
Signed-off-by: Stefan Weil <sw@weilnetz.de>
Steven G. Johnson [Tue, 14 May 2019 15:00:08 +0000 (11:00 -0400)]
slight clarification
Steven G. Johnson [Tue, 14 May 2019 14:53:55 +0000 (10:53 -0400)]
update header file comments (closes #157)
Steven G. Johnson [Sat, 11 May 2019 01:24:14 +0000 (21:24 -0400)]
NEWS for 2.4, updated version numbers (which I forgot in 2.3, grrr)
Steven G. Johnson [Sat, 11 May 2019 01:13:32 +0000 (21:13 -0400)]
ignore vscode
GOTOH Shunsuke [Sat, 11 May 2019 01:12:45 +0000 (10:12 +0900)]
update for unicode 12.1 (#156)
Steven G. Johnson [Wed, 8 May 2019 15:24:51 +0000 (11:24 -0400)]
typo
Steven G. Johnson [Wed, 8 May 2019 15:24:27 +0000 (11:24 -0400)]
more info
Steven G. Johnson [Wed, 8 May 2019 15:22:37 +0000 (11:22 -0400)]
note official releases
Steven G. Johnson [Wed, 8 May 2019 15:20:25 +0000 (11:20 -0400)]
more compile info
Michael Osipov [Wed, 8 May 2019 00:02:19 +0000 (02:02 +0200)]
Document HP-UX build support (#155)
Michael Osipov [Wed, 8 May 2019 00:00:21 +0000 (02:00 +0200)]
Improve portability of Make (#154)
Several options passed to $(CC) are not portable, e.g., for HP aCC.
Move them to variables.
past-due [Wed, 17 Apr 2019 18:49:04 +0000 (14:49 -0400)]
[CMake] Add UTF8PROC_NO_INSTALL option (#152)
* [CMake] Add UTF8PROC_NO_INSTALL option
* change to UTF8PROC_INSTALL
Steven G. Johnson [Tue, 9 Apr 2019 19:10:20 +0000 (15:10 -0400)]
copyright year update
Steven G. Johnson [Tue, 9 Apr 2019 19:09:57 +0000 (15:09 -0400)]
fontforge is no longer needed
Steven G. Johnson [Sat, 30 Mar 2019 20:34:11 +0000 (16:34 -0400)]
Merge branch 'master' of https://github.com/JuliaLang/utf8proc
Steven G. Johnson [Sat, 30 Mar 2019 20:33:59 +0000 (16:33 -0400)]
NEWS for 2.3
Steven G. Johnson [Sat, 30 Mar 2019 20:31:02 +0000 (16:31 -0400)]
add utf8proc_unicode_version (#151)
Steven G. Johnson [Sat, 30 Mar 2019 20:05:50 +0000 (16:05 -0400)]
give up on Unifont for charwidth data (#150)
* fix CHARBOUND option for non-characters
* give up on unifont for charwidth computation
Steven G. Johnson [Sat, 30 Mar 2019 20:04:48 +0000 (16:04 -0400)]
Merge branch 'master' of https://github.com/JuliaLang/utf8proc
Steven G. Johnson [Sat, 30 Mar 2019 20:04:14 +0000 (16:04 -0400)]
doc clarification (closing #110)
Steven G. Johnson [Sat, 30 Mar 2019 19:22:25 +0000 (15:22 -0400)]
fix CHARBOUND option for non-characters (#149)
Steven G. Johnson [Sat, 30 Mar 2019 17:46:01 +0000 (13:46 -0400)]
update for unicode 12 (#148)
Steven G. Johnson [Sat, 30 Mar 2019 17:37:34 +0000 (13:37 -0400)]
rebased cmake updates (#147)
* Use a target property instead of CMAKE_C_FLAGS
It is a global property, which is not great when importing utf8proc in other CMake projects.
* Use target properties instead of add_definitions
It modifies builds settings globally, which is not great when using
the library as part of a bigger CMake build
* Expose header search path with target_include_directories
This makes it possible to use utf8proc in a larger CMake based project
with
add_subdirectory(utf8proc)
target_link_libraries(my_app utf8proc)
* more rebase fixes
Steven G. Johnson [Sat, 30 Mar 2019 17:17:21 +0000 (13:17 -0400)]
use Travis Julia support to get a modern Julia version (#146)
use Travis include: to specify Julia version
Steven G. Johnson [Thu, 1 Nov 2018 21:17:06 +0000 (17:17 -0400)]
fix Julia script for Julia 1.0
Graham Inggs [Thu, 1 Nov 2018 21:10:48 +0000 (23:10 +0200)]
Pass users' flags (#141)
Michael Drake [Thu, 1 Nov 2018 21:09:16 +0000 (21:09 +0000)]
Generate and install a pkg-config file. (#142)
* Generate and install a pkg-config file.
* Use Makefile libdir and includedir for pkg-config.
This splits the prefix out from these variables, so that
the same variables can be used to construct the pkg-config
file.
* Update the manifest for installation of pkg-config file.
* Revert "Use Makefile libdir and includedir for pkg-config."
This reverts commit
a4cd6dc64a357dd5b91781045b3ac1c4679af97f.
* Use Makefile libdir and includedir for pkg-config.
This splits the prefix out from these variables, so that
the same variables can be used to construct the pkg-config
file.
Steven G. Johnson [Wed, 25 Jul 2018 18:11:33 +0000 (14:11 -0400)]
link fix
Steven G. Johnson [Tue, 24 Jul 2018 17:35:48 +0000 (13:35 -0400)]
badge updates
Steven G. Johnson [Tue, 24 Jul 2018 17:32:15 +0000 (13:32 -0400)]
doc fixes, don't export stdint and limits.h values UINT16_MAX and SSIZE_MAX
Steven G. Johnson [Tue, 24 Jul 2018 17:25:51 +0000 (13:25 -0400)]
Merge branch 'master' of https://github.com/JuliaLang/utf8proc
Steven G. Johnson [Tue, 24 Jul 2018 17:25:38 +0000 (13:25 -0400)]
2.2 release date
Steven G. Johnson [Tue, 24 Jul 2018 17:24:56 +0000 (13:24 -0400)]
update copyright statement for data_generator
Steven G. Johnson [Tue, 24 Jul 2018 17:20:49 +0000 (13:20 -0400)]
copyright year updates
Steven G. Johnson [Tue, 24 Jul 2018 17:19:42 +0000 (13:19 -0400)]
note Unicode 11 in NEWS
Steven G. Johnson [Tue, 24 Jul 2018 17:18:48 +0000 (13:18 -0400)]
update data and algorithms for Unicode 11 (#140)
Steven G. Johnson [Tue, 24 Jul 2018 14:45:02 +0000 (10:45 -0400)]
charwidth=1 for soft hyphen and unassigned codepoints (#135)
* use width=1 for soft hyphen and for unassigned/PUA codepoints
* don't count unassigned codepoints when comparing with system wcwidth
* more tests
* indentation fixes
* NEWS for 135
* remove special-casing for arabic control characters affecting a span of numbers, which are sometimes zero-width and sometimes not
* regenerate
Nehal J Wani [Wed, 6 Jun 2018 14:16:07 +0000 (19:46 +0530)]
Enhance CMakeLists.txt (#138)
* Change name of static library if building with msvc
* Add install target for cmake
Steven G. Johnson [Wed, 2 May 2018 18:18:26 +0000 (14:18 -0400)]
uppercase mapping ß (U+00df) to ẞ (U+1E9E) (#134)
* uppercase(0x00df) = 0x1e9e
* tests for titlecase and u+00df uppercase
* NEWS, another test
Steven G. Johnson [Wed, 2 May 2018 12:23:40 +0000 (08:23 -0400)]
NEWS for upcoming 2.2 release, version bump
Steven G. Johnson [Wed, 2 May 2018 12:15:02 +0000 (08:15 -0400)]
Case folding fixes (#133)
* Fixes allowing for “Full” folding and NFKC_CaseFold compliance.
* Only include C (Common) and F (Full) foldings from CaseFolding.txt. Removed S (Simple) since F & S are specified to be exclusive.
* Extend UTF8PROC_IGNORE to also ignore unassigned codepoints (such as \u2065) which are specified as being discarded by NFKC_CF.
* Document the changes to UTF8PROC_IGNORE in header.
* Add NFKC_CF helper function with documentation.
* restore old IGNORE behavior, add UTF8PROC_STRIPNA, rename to utf8proc_NFKC_Casefold, add a test
* success message
* test that IGNORE does not strip NA
* data update
* NFKC_Casefold shouldn't strip NA
past-due [Mon, 30 Apr 2018 01:37:12 +0000 (21:37 -0400)]
Static library support improvements (#123)
* `#define UTF8PROC_STATIC` to disable DLLEXPORT
`#define UTF8PROC_STATIC` to disable DLLEXPORT
* [CMake] Automatically define UTF8PROC_STATIC if BUILD_SHARED_LIBS is off
* [Makefile] Support additional UTF8PROC_DEFINES, which can be used to specify flags like `-DUTF8PROC_STATIC`
past-due [Fri, 27 Apr 2018 16:55:53 +0000 (12:55 -0400)]
[CMake] Use target_compile_definitions to avoid affecting global definitions (#121)
Steven G. Johnson [Fri, 27 Apr 2018 16:51:07 +0000 (12:51 -0400)]
note Unicode 10 support
Steven G. Johnson [Fri, 27 Apr 2018 16:50:19 +0000 (12:50 -0400)]
update to unicode 10 (#132)
Steven G. Johnson [Fri, 27 Apr 2018 13:58:34 +0000 (09:58 -0400)]
version bump to 2.1.1 (#131)
Steven G. Johnson [Fri, 27 Apr 2018 13:30:37 +0000 (09:30 -0400)]
fix make clean
Steven G. Johnson [Fri, 27 Apr 2018 13:10:38 +0000 (09:10 -0400)]
missing return code, success message in test/misc.c
Steven G. Johnson [Fri, 27 Apr 2018 12:57:54 +0000 (08:57 -0400)]
make internal function static
Steven G. Johnson [Fri, 27 Apr 2018 12:23:10 +0000 (08:23 -0400)]
added test for #128
Benito van der Zander [Fri, 27 Apr 2018 12:06:14 +0000 (14:06 +0200)]
possible fix for #128 (#129)
Does this help? I do not really remember what I wrote back then
Ryan Schmidt [Wed, 18 Apr 2018 14:50:15 +0000 (09:50 -0500)]
Use LDFLAGS when building libutf8proc.dylib (#125)
Branko Čibej [Thu, 21 Sep 2017 16:27:24 +0000 (18:27 +0200)]
Fix declaration-after-statement warning when compiling in strict C90 mode. (#113)
Christopher Baker [Thu, 8 Jun 2017 16:29:54 +0000 (11:29 -0500)]
Update documentation to reflect Unicode 9.0.0. (#107)
This makes the inline documentation match the README.
Paul Smith [Sun, 19 Feb 2017 22:33:25 +0000 (17:33 -0500)]
Ensure generated const data tables are hidden via "static" (#100)
Jameson Nash [Sat, 18 Feb 2017 15:14:45 +0000 (15:14 +0000)]
don't set MAKE variable in Makefile (#99)
fix #95
Árpád Goretity [Sat, 14 Jan 2017 13:12:29 +0000 (14:12 +0100)]
removed inclusion of non-portable header file (#94)
Michael Hatherly [Wed, 4 Jan 2017 00:44:23 +0000 (02:44 +0200)]
Don't use cached version of UnicodeData.txt (#92)
Ref: https://github.com/JuliaLang/julia/pull/19725, UnicodeData.txt is
now being cached in JuliaLang/julia's build.
Steven G. Johnson [Mon, 26 Dec 2016 21:01:42 +0000 (16:01 -0500)]
fix typo in NEWS date
Steven G. Johnson [Mon, 26 Dec 2016 20:52:48 +0000 (15:52 -0500)]
version 2.1 release
Steven G. Johnson [Sun, 11 Dec 2016 21:42:24 +0000 (16:42 -0500)]
update NEWS [ci skip]
Steven G. Johnson [Sun, 11 Dec 2016 21:35:27 +0000 (16:35 -0500)]
update to unifont 9.0.04
Steven G. Johnson [Sun, 11 Dec 2016 21:18:52 +0000 (16:18 -0500)]
whoops
Steven G. Johnson [Sun, 11 Dec 2016 21:17:11 +0000 (16:17 -0500)]
use ptrdiff_t rather than ssize_t, as ssize_t is non-standard (it is POSIX, not C)
Steven G. Johnson [Sun, 11 Dec 2016 12:15:53 +0000 (07:15 -0500)]
use stdbool.h and inttypes.h in MSVC 2013 and later, and use more C99-compatible definitions of false and true earlier (fix #90)
Steven G. Johnson [Wed, 30 Nov 2016 15:46:01 +0000 (10:46 -0500)]
update .gitignore for custom test
Steven G. Johnson [Wed, 30 Nov 2016 15:40:26 +0000 (10:40 -0500)]
new utf8proc_map_custom for hooking in user-defined custom mappings (#89)
* new utf8proc_map_custom for hooking in user-defined custom mappings
* whoops, add test program
* NEWS, version bump for 2.1
* change test functions to static so that gcc doesn't complain about missing prototypes
Steven G. Johnson [Wed, 30 Nov 2016 15:09:18 +0000 (10:09 -0500)]
silence MSVC warning about conversion to uint8 (fix #86)
Steven G. Johnson [Tue, 29 Nov 2016 18:49:03 +0000 (13:49 -0500)]
typo in docstrings
Michael Drake [Mon, 21 Nov 2016 14:22:39 +0000 (14:22 +0000)]
Tlsa/ucs4 normalize (#88)
* Split codepoint sequence normalisation out into separate function.
This creates utf8proc_normalize_utf32() which takes and returns
a UTF-32 string, applying the following options:
- UTF8PROC_NLF2LS
- UTF8PROC_NLF2PS
- UTF8PROC_NLF2LF
- UTF8PROC_STRIPCC
- UTF8PROC_COMPOSE
- UTF8PROC_STABLE
The utf8proc_reencode() function has been updated to call the
new utf8proc_normalize_utf32().
* Update code documentation: utf8proc_reencode handles UTF8PROC_CHARBOUND.
Jakub Vít [Sun, 4 Sep 2016 18:44:39 +0000 (19:44 +0100)]
Change definition of UINT16_MAX macro (#84)
Change UINT16_MAX from `~(utf8proc_uint16_t)0` to fixed value `65535U` to prevent weird behaviour in complex expressions.
Steven G. Johnson [Wed, 27 Jul 2016 12:04:38 +0000 (08:04 -0400)]
add missing links
Steven G. Johnson [Wed, 27 Jul 2016 11:59:43 +0000 (07:59 -0400)]
date fix in NEWS
Tony Kelman [Wed, 27 Jul 2016 11:58:49 +0000 (04:58 -0700)]
NEWS and version numbers for 2.0.2 (#81)
* Add NEWS.md items for #79 and #80
* Prepare version numbers for 2.0.2
* Also update API version to 2.0.2
Tony Kelman [Tue, 26 Jul 2016 21:54:17 +0000 (14:54 -0700)]
use a different variable name for nested loop in bench.c (#80)
and declare it ahead of time to avoid "error: 'for' loop initial declarations are only allowed in C99 mode"
Tony Kelman [Sat, 16 Jul 2016 10:16:03 +0000 (03:16 -0700)]
Move -Wmissing-prototypes from Makefile to .travis.yml (#79)
since MSVC doesn't understand this flag, and the current
mechanism for building Julia with MSVC goes through the makefile
petercolberg [Wed, 13 Jul 2016 16:58:28 +0000 (12:58 -0400)]
Convert compiler warnings to errors for Travis builds (#73)
Steven G. Johnson [Wed, 13 Jul 2016 16:42:07 +0000 (12:42 -0400)]
added NEWS for #78